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VIDEO SURVE I LLA1JCE SYSTEM AND METHOD 

^CHNTC^ ' THE ^INVEOTIQN: ;: ; : // : a-V 

^v; ^- This' iny^ to; surveillance 

and communication: systems, and more specifically to a 
video surveillance system and method. 

5 

vRTxricnPOTTNn QF^THK. INVENTION.^ .. 
• • • : iy-<>y : M : :^ Tof 'iale : ( RQS ) ^ device ;^ an * automa t ed ; ite 1 ler; 

,■0^%;. machine^ other^simil^ ■ 

as spc ia: t ed wi t h ; a f inane ial vt ransac t ion . For example , -. 
10 a POS device may generate data associated with th^ 

sale of : an ; item,- whereas an ATM may generate data 
.associated with, a: cash withdrawal by. a customer .:; Due 
tp v hutnah: error , . intentional.; misconduct > or machine 
- malfunction,; there may> -be a desire .to ^display ■■ypr^:-^- 
15 analyze event is associated with these financial 

. j>:;^;..Vu;;;.t^ ■. • . : ;.\:-,?..; /■ v::^ ! v*s; \ 

^monitoring; of f ina ; ; For v example ,. 

.some surveillance^^ associated with 

2p ••• ••';\>:w : K ; - financial ' transactions^;' ;^:f or later ; r; ana lysis/ and ,>;^- 
reporting. Other surveillance systems store video 
images on videotape for later, visual analysis and 
. v Creportingivof^the invent .. Still other, system? as.soc ;a t <e : . 

;store^yon / ;y ideota^e :.l • : / - , ; "4 ' 7 V.- ^/^X^X-' 



m 5UMMAtY^ OF -V THE ^ INVENTION 



"• ' . in accordance with Che present invention, 

disadvantages. ;; and. ; . problems . .asspciated., 

•.-fy-j,-.. ■ ,-\*:* 3Q- : ''*; : -:^su^ 

: or ■ eliminated. In particular, the present ' ihv-;;- 
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provides a video surveillance system and method that 
v Go^ihes data/, v 

<:yy^^ 



site 



:);fpr6vid^ 



|||f '■ ^ ^ the , 

ife^ jpresent invention provides a video surveillance system 

] 0y. and method that combines data, video, and optionally 

10 audio associated with a financial transaction and 

f^;_ . transmits - this ^inf pfmati^ . 

flsfe;':' is'" 
|fS : •' :'VoVP/ : *V data . . 

' ]&:*:p&U^£' : --•'•"in • aicofdancV with' one embodiment bfe present 

S|g 15 ■)<:' invention, a video surveillance system includes a 
SSfi^ • -client that generates data associated with a financial 

■ - transaction'; Thevclient - has. a>ca^ generates 

pip ;X '- : y{. ■ "video-associated with t he f inane i al t ransact ion . The 

| l $Sv- • '"y-y' :: • : ^client - stores data and video in a digi tai 1 f i le . A 
0ps^' 20 server is coupled to- the client us ing a communicat i ons 

. >\%V .;; -n^ ient 

^lw\V - v * " T -\ ■ :; has ^ graphical; ; interf ate that retrieves data and 

!!§£;;.; "video from the digital file stored in the memoiry for 

^Sl-y y : : -: : -2S ' ' : >:.k : ^-present at ion ; : '^f\7fy yy. 1 ;- ' '■ ^'"V ' '■ ' ' 

In accordance 'with another embodiment of the 
-VV''y •"• present' invention, a video surveillance system 
ll^'V; : : y^S's)-^^ a include s a ; c 1 ient that. ; generates • data:;:as soci;at ed with 

|||^^ 



Sl^v'" ; i--^ v / •. 3 p;.^'S: ^ \ ; gene ra t eS: : ^ ;yide6/C';:'- i'a s s o c i a.tfed%: if wit h r ; ''^ t hist; ■ •.; j; f inane i a 



\^,y'7: : . \ : . i : :;: over .Va -^ommuni c a tion nety*^ 

the client using the : communications network and 
receives the data and video from the -.• client . The 
3 5 V ^ i ; s in >real^ time. 
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Important technical advantages of the present 
W\. invention include the storage . arid^or real-time 

|% transmission x>and : ^^^^ ancU 

§/;;- optionally, :-audi^\;v; as social ...with-, ^.a-..' . financial 

|v&. • 5.. : ^tr^nsactlon^^ .sychC;a?.\ : ;>a.., 
^\ point - of -s^e^ ,ca^h:^gi,^t^rQor an v 

§fc ' ;: - aiitomat^ ' machine A^)' : generates " data 

associated with and/or upon; : the occurrence of a 
financial transaction. The client also includes a 
„ 10 camera that generates associated video and optionally 

a mi c r ophone < : t ha t; generate s a ssoc i a ted . audio . Tlie 
J-.;.: :: - -v, ■ -C lleht'Smay^ 

• 'mult imedia;-, digital . 
the client includes two modes of operation. In the 
15 first mode, the client includes only data associated. 

; with the f inane ial. tra in the digital file . 

In the second; mode> associated with ; an exception 
condition of the financial ; transaction, the client 
includes data, video ,. and opt ionally audio in the 
20 digital file. The exception condition may be defined: 

bY^informatipn^r ; 
■ J: '.XlZ ... : y, : .; ':f |^:^of a^^; - /q f i^dik f e r e nt;-^ vin f or mat i on? ^ in tp : ^a^ t 
^ ":V; digital file provides several important technical 
: advantages. The digital ^file may, ^be formatted, 
• ; -2S, : ' compressed, • ; and\ : ^cqi^Tmnicated ' v^Using v. digital : , 
communications- technology;- The: digital file may be 
scrambled, rearranged^ encoded, or otherwise processed 
; tp ;: preyent ::.tampering :or disasspciation of data, video, 

'-M-i ^^-z^^ /^ : 7&bt^ ;- ; advantage - of the| 

fe- . present invention includes a server- coupled to the 

. . .. .client that ^retrieves the digital,, file. .The server 

>f^ : ^ server tb '-display /;= analyze , . and v : generate - r eports 



on information contained in the digital file. In a 
particular - : embodiment , 'Vthe^sefver is coupled to a 

: ; 'piuralit^ 
•digital if ile^ 

/t : he rfcla ent ^- v :v ; : Tl^#se rve r^? -co llect a^Jand- • Vs tore s ; : ; -tHese^ : 
r; : dI*git;S0-"-f i 

accesses the ^ .d^tabai^e • : ^?td ■'■■^ • allow ^e lect ion* • ' 
presentation, analysis; and reporting of the financial 
transactions represented by the digital files. In a 
particular embodiment; data for 'each financial 
transaction 

; ^inaric'ia^ entries;": mayV 

"indicate ? the 

data . The graphical interface may also include a 
video window for viewing associated video and a 
search/ report window to allow selection and analysis 
of financial transactions ^- 

In ario t he r e mbod i me lit , the client provides a 
further technical advantage- by transmitting data, 
video, and -audio across a communications network in 
real - 1 ime; / Addf t ionally ,^;dat:^;<^ ted j from 

■4t 5 he7- : l c-i'ien £- v-to'vthe'-y'seryerv upon ^ init ial i za t ion ivof ; /:r.a; 1 
rea 1 - 1 ime ; ^c6nne c t ion . This data may represent daily 
sales - total , transact ion totals , number of items sold 
sine is last contact or some other information . In this: 1 
embodiment/ a server coupled to the client receives 
the t ransmi 1 1 ed da t a and v ideo . The server includes 
a display -thatV: allows : the :; data ; to,: toe:, shown ^.s , a .^data, 

^i^6m^6y^r^id ^^ on i/ the\ i:assoc iate^^^^ 

:\.data^win<^ 

;-::di sp iayedv "^tln^ nient,fv^the::;S eryerKa s ; : 

:-'coupied! ; ''to.Wa "roiients:::; an^ / .each^cl'ient 

transmits data and video for financial transactions 
occurring at the client. The server displays these 
-transactions : : dri multiple ^ windows . : An; -operators can 
change the- views ih the windows or the windows can bo 
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changed automatically, based on some preexisting 
criteria; Other technical advantages are readily 
■ apparent to: one skilled. in the art from the f ol lowing 
figures , descriptions, and claims . 

RR f^P^ TWF HRAWTNG5 : ■ . . 

; vFor a :> 
invention, and for further features and advantages, 
reference is now made to the following written 
description taken in conjunction with the accompanying 

drawings, in which; : K • , v..:.;- : . ;.i 

' v . , FIGURE 1- illustrates a y id^wsu ? 

V j FIGlJRE: 2 illustrates; a^Ic^ yideo ; 

, . surveillance system; 

FIGURE 3 illustrates a server in the video 

surveillance system; 

FIGURE 4 illustrates a graphical interface at the 
se rve r in t he video survei 1 lance system;, p 

, FIGURE 5 illustrates the , components of an 
exemplary digital file used in the video surveillance 

— ' v bf the Client in the Video ^ suryei llance; system ; ■ 

FIGURE 1 is a . f lowchart of a me t hod o f ppe r a t ion 

■ " \:^v .■ of ■ the server in, .the video, suryei llance: system; j.pyjW' :: 
FIGURE 8 illustrates a video surveillance system 
capable of real-time transmission of video .and data; 

... } . ...J..., ,:., ... FIGURE ? illustrates a : display ; which, includes a 
£V ^/^ ^yideq^'Wi^ow'- 'an^:one;'6r^^re : "data -..windows ; y;y. ;) y. '-'-y \ 

display diy4.de4 in^P^ 

'W V : : =i " ^ p i GURE / 1 1 ' is 'si \ flowchart of real - 1 ime ;<tet3-- ; : and_ / 
.7.^"'■"\"■ video transmission; and 

FIGURE 12 is a flowchart. for. a method of. updating 

.■';' : 'ri':L-:^data.'- : fromV.a,. -client . ^y^,:^- : '^. v- 
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PmXJUB P . , JQ E SC R X P T XON OF THE SNVENTSQN 

i; ; . • FIGURE 1 ^illustrates ^ -y surveillance system 

: ;^Ip^ 

'•/. -uslrig ■ -'a ionui^nicat 

'?;^tay ; .;7yd^ 

^ ^ : •'' •• •' y tih^nciai; > Clients 12 communicate 

digital files 14 to servers 20 using network 24, 
Servers 20 store digital files 14 received from 

10 clients 12 in databases 18 , and provide remote 

monitoring^ . , .- reporting> ' >• and analys i s:; >• of • f inancial 
■ I IV; V VvcV; . 

, Clients^ ; wi th ^any- 

electronic device ^that generates data on a ' f i nan c i a 1 

15 transaction, such as a point-of-sale (POS) device like 

a cash : register, automated teller machine (ATM), or 
any other appropriate device that generates; data on a 
financial transaction. Clients 12 may be located at 
one or more / sites ,r associated with 'one or more 

20 business organizations, or otherwise arranged or 

grouped in; any ^ Por,f example , two 

V ' ''^^i^W-^ ?i ircl i e n t s^ 1 "; i2^^ inria^ ^Be^ c o - lo cate^/ : ^t: : ; : a • • . ;s i t e, 

operated ■■ ■'■■ : -by: : ' : .^he'" same Business orgahi zat ion , or 
otherwise associated as indicated by bracket 26 . Each 

25 server 20 in -system 10 : receives; digital: files 14 

associated with financial transact ions occurring at 
one or more designated or associated clients 12. 

■(^\:^$^ 

^^;^^ : ^.-±n any' ; suitable J:conan^riicat ipns : ; :networkv;6r '■ computer 
network, such as a local area network (LAN) , wide area 
network (WAN) „ public switched telephone network, 

"3 5 -' integrated services digital ne|^ 

5 6 telephone network, private branch exchange (PBX) , 
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the global computer network known as the Internet, or 
any other appropriate technology or technique that 
allows , ; components; of system ^10 ; . r t 
information. Although client : >12 a^ 

5 V ■': ; ref erredS^to;^ in the- nomenclaturec of •-a^iciient/server : 
• ^:?..-y,v,/.^, e'rivi'rbn,ment^ v 
and Server 20 may be' any ; type o^ 

any suitable environment that communicates using 
network 24. Each component in system 10 includes any 
10 suitable hardware and software components to interface 

with and communicate using network 24. 
In a parti 

; ^ ^ pne-way v; and , two-way ;aud£o/yid^Oy ; ^conf e^ncdlng. 
V Throughout^; this description, audio/video conferencing 
15 includes conferencing of audio alone, video alone, or 

both audio and video,; together with any associated 
data. For example, network 2f may include components 
to implement an integrated services digital network 
(ISDN) /communications facility that : supports;;; the ITU . 
20 H . 320 4* video conferencing standard. In this 

•en±>odiment ,. each component of system 10 may v i^ 

^/Sj;^ 

■ ; • interface -cards , and other hardware and software to 

implement audio/ video conferencing and underlying data 

•2'^-y/; ;^ ; trans fer'./'i:^.-. 

An alarm monitoring station 28 is also coupled to 
network 24 and detects alarm conditipns at . clients 12. 
. ■. In response; to this '.detection,, station. 28 ..establishes 
t^%/ ;. cqmriunica^ cli^nt;; : .^I2 • '^a^; : jT: : ;j\ 

{^0^:::\: geneyates./tHe \ alarm 'condition ; : . . '.Station - 2 8;; mavr di sp lay v •■ 
^i^^Sd^ln* a^'.-di reg t dedica t ed'(^ teal - 1 line , : or.'pearCreal ^Xi^v''- -S^ 
" f ashibn - data, video/', and audio generated vat • 

particular client 12 that generated the. alarm 
condition. Station 28 may also perform one-way or 
: .;:.; Xi wo -way ;;au^ particular :;| . 

/•. client 12 ;ln a particular • embodiment.,, station 28 
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alerts and dispatches police, fire, security, or other 
Iff-'- officii >: 

piV.; ' w : ; ' • ; : ' ; •: ; • • . •; /Inu^;.i;ope r a ta6nv: : ' : clients 12 perf orm "flnanqial M:-}i'S- 

B||:L\ "•/••'V:';;-. ' : \;jfcr^ 

iS^f:- ! "- : -%eceives^di 

|f&V these digital files 14 in database 18 . In one 

Sit- embodiment, database 18 maintained at server 20 

10 "includes digital files 14 collected from numerous 

: iclierits ^12^; Server : 20 includes a database mahagement 

■'.:}■■.:: ; ;'Vy:^Y^ 
f^Sp;; -^y. _ • : ^£%fta^ ' reipqrj;, 

ft||v/. oc c u r r ihg^^a: t • • clierits ' 12 that correspond to digital 

15 files 14 maintained in database 18 . 

;5fST ' -/^fettURE 1 ' 2- illustrates client 12 in more - detail , 

^ to devices 50 include microphone 52 ,. 

speaker 54, cameras 56, and display 58. > A video 
.-: swi t ch 60 , coupled to cameras 56 and display 58, 

§§fe.;-- 20 selects video from one or more cameras 56 . A video 

tt>!---.-- ; ; ;:;: v-. v ;v::: ; -:cassette ^iecotd^ 

tft§#--''£ and audio information on ... ' 

•'" "'' K ..'•••'%ideotape;' ; '64'. ■ - ■ • ; ;; > : 
:§ftv- -25 ■■■ ■ v ; ; Input/output devices; ; 50 are " ' couplsd " to - ^a'y^ 

|S:f: ; - converter 70/ which passes video 72 and audio 74 in 

;|gh digital format to a controller 76 . Con t ro 1 ier 7 6 i s 

. coupled to and receives, data 82 regarding > 

W&^^ any * o the r videy i c e" ' ; - : vv : \ " 

;- : ;^'r?-3P : " - 3 ^^^^^^-^^ ■ \<3^ '82 ^ :;^0ire ^a^di ng ;^/7a..C : f inane ia^ ■*. 
ttif; -£/ i t. i^K^lso £ 
ppj^v^ -'-and''.- "represents : - va'- : : motion • .detector,-^;;..;.; /^v- 

pSf ; ' clock, panic button, or other device that generates an 

alarm condition 85 at client. 12. 

vis: ; : coupled - to: ^database -1^ whic^ 
ISSl'-' - . ; ' ; stores^<iagital' f iles 14 ind exception condition 84 . 
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Mi'-) 1 A-i 



Exception condition 84 comprises information that 
directs . client .12;. when to. . store videos : and.. ^optional 
- audio ; -for,, particular ..financial; . ^,transac^na;;- ■ ,;For -.. 
>;'1^/''%: V - example^ 84 may- repr^entrone ■ or. 

_ 5; ;:;^:;; ; . ^..moriVacii^ . 

WP ' : - v P ^'''P^^i^viiieo ^72 :f^/^f$n^6:, 74 for ^the^^^riahcial*' 

transaction . . Exception ^condition . 84 may $e def ined as 

a noise threshold in audio 74 or a pixel or picture 

variance or .difference, threshold in video 72 that. 

when exceeded, triggers . the capture of video, 72 and 

'." audio 74 Controller 76- is also.coupledv-to^ ■ 

which: in u turn is^ coupled ^ 

88. .v '•■•;>.'' >■ 

15 particular components of client 12 may operate on 

one or more computers , shown general ly as computer 9 0 . 
Computer 90 maintains and executes, the instructions to 
" implement converter 70, controller^76^ :code^ 66, and 
interface 88 , . and includes any suitable , cpmbination . of 
20 hardware and software, to provide the described 

.. function or operation of these components.. Database 
/ . !\ . ^| !n'.i^;^ompr i ses . ^"one.;." ?r| ^'more^ J i ^ ' & : ??t ' other 

S.\ * "arrangement.^ of information stored intone or more 
" . r components , of random access memory (RAM) ( ! read only 
25; s f ; ? ; memory (ROM) , magnetic computer disk, : < CD-ROM,\ other 
- ."magnetic or optical storage media, or any other 
; : : ; : . *; volatile or nonvplat i le memory,. .> ■ •>;•■ ^ 



. . Computer, 90 .•.includes ...an^input^. device ^92 jv ;Such as . 



Iff?;- 



IS? 



•su'eh\';as-. a ' 
itff^'rma t-ion 

■;: : ^ff 5I ierit;;i ; l 2 1 ^including 

..A;v;-;^# '-'V .•/ a^t. a i : ^ ; data , '. visual . : V . .informatiorv, , '^or>/. audio 
' ? ^/../information.^ Both, input ...deyice . 9.2 . and output, device 
J, .\/:35;/S;;4&^, ; ;may include f ixed : b.rsr 

; •" . '• '■ •• Was" a "magnetic computer, disk . CD - ROM ,'• or other suitable 
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media to both receive output from and provide input to 

§pi; ; ; .' • : - : clie]^ ; :vl'2'- . : ' Processor. 96 and its a s s o c i a t e d memory 

• • Accordance. ;::wi :.l£-^.;v" 
pfs' ^xinip^^^ ■cimeras; 56?:^ 

#% display video in a standard television format such as 

NTSC or other analog signal format. Similarly, 
10 ' microphone 52 may generate and speaker 54 may convey 

' ;-v ; v:audip. : information ; in • ana:l;og : f qrTn . • If ^appropriate , 

' : . devices;; 50^ i digital s for • 

Ifffr video 72 and audio 74 used by controller 76 v In one 

15 embodiment, input/output devices 50 generate and 

|§|c ' ' receive digital data - and the Operation- of converter 70 

1 is unnecessary, . ' 

- Upon- the occurrence of a financial transaction, 
pfc ■ - V" ATM: 78 ; ; or POS 80 generates data; 82 associated with the 

|S% 20 financial transaction. Controller 76 analyzes video. 

MM< '■: ■ ,'^;2 > : ^;.- : audio 74, % ^nc3/:or / dat^ determine if V-\i.t-. ; 

|if •■exception"' cond i 1 1 on ; 8 4 - s toired in ■■■ dat¥Baise 16 ; In a 

. ..- : - ^ ' first mode, controller ^76 determines that video 72 , :/ 
pvl v : . 25 r ' •;••• audio 74; ahd/6 r da t a 82: are ;. not associated with 
" exception condition 84 and ; stores only ' diata 82 
generated by; ATM 78 or fOS 80 as digital ' f ile 14 in • 
•: , ;dat abase . .^iS:;^.^^ 

ipfe/; : ...'3 9 ' v ]/;. ^enerateds b^'^A ^asspc iated;i:;. wi trh 

the- 

1^1^- second mode of operation, controller '76 includes data, 

video 72, and optionally Hudio 74 associated with the 

' ' • "-database "16 ' ■ ■\-y.:^y--V- ■■■■ — -v- ■•^u^y^-.?^ •••• 
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Contemporaneously with the storage of digital 
file 14. . in database ,16. ;.;.or ,at. an. apprppriate later 
/;vt%me',,-.. cpntxpller^j^ one; vpr. ; :.more ; -digital .: 

:; : ..v.'f iles; 14;! ; f rom^d^aba^ ' 
• . ■'■20; "usin^-codec-;:^ ^network- .;-;2 4 '•■ 

^'el ient^l^ i$ : ■ £° "i 

server;f2#^ ^.rFbir ^ample;, ; ' • 

client 12 may. communicate digital files 14 to server 
20 at off-peak hours, at the end of a shift, at 
specified intervals during a day, week, or month, or 
.. ... at. any ; ,Qther of .. app^ropri . the 

'' - particulars regjuirements of : the ;business^or^anizatipn 
' bperating > client;./ : 1 2 . ../ ^n: .addition, //client.* 12 may • 
initiate communication, of digital files 14 : in response 
to a command received from server 20 over network 24. 
Also;;, a larm condi t ion 85 gener at ed by alarm 8 3 may 
cause , client 12.; to immediately; communicate digital * 
file l4;:(associated with: alarm condition 85 . In this 
embodiment,: -client 12 may . transmit -alarm condition 85 
to statipn 28 and establish a direct , dedicated, real- 
time , : <|pr ; near, real - t,ime one-way, or two-way audio/video 

1 n -icombinat ion . from the 

generatiohj:. and., communication of digital files 14, 
. cli ent' --J^iX; i • also . : support s>:/.. .one-way /> :^ 

audib/videb conf erenc ing us ing network 24 . For one- 
: way , r ;:audip/video.. : ; conferencing, . .•cpnyerter 70 passes 
. video/ /7 2,.!.f rom :v cameras 5 &, ; and . *udi£ w74./. f rom^microphcne^ 

: ■'' ' ^.^'20.. ; ^Control l<2r .y-76/ --may ^also --.include .any da.a' 
generated ■ at ' ^client ■ ...12 . in the conferencing 
.'. '.. information . , ,, ; In. ,' a . part i c u 1 a r embodiment , . , or.' • 
^4audio/videp^ ingisignal^s; ^re multiplexe.i : :. i ■ 

■ : : / ; V ; compressed' onto- a single {digital bit' data ; „strea~ 
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hp, 
Hi 



is- 



transmitted to server 20 or station 28 using the ISDN 
cpmmurii cat ions stahdardVsuppiorted 5 ; by 'network 24. 

" :; '^ C int€irf actf..;-? : 8|8^ 

incoming signals from codec 86, separates the signals , 
and passes video 72 and audio 74 to converter 70. 
10 Converter 70 performs conversion, if appropriate, and 

.presents; incoming: conferencing signals speaker ; 54, 
: \ ''' , "-.v'and;^ 

:i ; f romy.^ conferenc ing^signals^f:--" :? : -: ^{fy-y: 

In a ; par t ibiil ar 1 embodim^ntV • real - 1 ime video 72 
tfiSy 15 and optionally audio 74 is;: sent along with 

' corresponding data 82;^ g ATM 7 8 or POS 80 i; 

. The term "real-time" means; rea 1> t ime , • h ,\ 
yy§;. • . v-vv'or cqntemporan to. 

•• ^limitatidns^ : '- ; in y communication^ systems^ that j causfev 
20 substantial time to elapse between the capturing of 

%0£'\ ■ vV--v£&£9^^^^^ -server;: ;2 0'- : ^\-\ Irvy 

Il^x-- y> -^.^.'--tl^s^m -vi^'^ 

sent to- Controller 76 v tfhere it combines with datiei &2 ;v 
from ATM ^78 v POS 8 0" or any Mother ; devi ce ^ that generates 
- 25 data ''■■[ ''• : '':;82^^?'''''regardingJ\^ ay ; 7 financial"; . } t f ansa c t i o n . ;^ 

Aiterriatively ; instead of controller 76 , any other 
device 



fty& "■ 

§tt|y , , , , , . - .. ... . , . .... ... ... . . .. . 

^g})|:v;^"^r-;-;;;S ^£yvf^^^ yyAdditionall^^ 



30 / >y \ : h ,J, : can; ^ ;^;^'rarismil: ted ,y ; .eabhv^^ a* :di-f $ ev$h tvS;S 

:v ;^;;yp^ 

• ^it-'y v : • ;'occuri:. at yt^iTtipie^ 

along with the corresponding data 82 over network 2A 
via "interface 88. Alternatively/ data 82:;;- can L-~ ■■ - 
■ 35 •• • •■'S:tore^:in <; database:: 16 over - a ^period of y tlme;y; : s :; ^XJ?r::\y^ :■. 

est ali) 1 i s hme n t , of network connection "or some oti.-r 
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occurrence, data 82 is transferred from client 12 to 
server 20. Server 20 can then query either ., its own 
^database 18 or database; 16 at Vserye^l2* 
•••• "' v^;;;;' figure;'- 3; illustrates server 20; in m?re y detail . ^ 

,: I" ■ ' ^'^pi^h^ r . 104 , .;and ; ;s^eaker Jnput/outpu ; 

coupled to network 24 using an interf ace 109 . A 
controller 110 is coupled to codec 108, display 112, 
10 and input devices 113. Display 112 displays 

information contained in digital .f^les.- 14 received 
irbm^, clients; ;i 2 '^'l^ 
[ ^;:§raphicai;.. interface ^: 1 16' that callows : ; ; a^user qf ;^erver 

20 to display; select , analyze, and report on 
15 financial transactions occurring at clients 12 that 

correspond to digital,: £ile^; 14 maintained in ; database 
18. • Also; - inc ludedv in ^databa:se ;jL8 is ; a data 
conf igurat ion 1 5 which allows data to be overlaid on 
. display::ll2uin; ay varied formats. Input, devices 

20 113 may include a keyboard, mouse, other pointing 

, .., d^-ica-,. or any , other; : appropriate input .deyice . th^t , 
V;/:-- -the^us^^ 
-:^\^ 

^Controller 110 is also coupled to database 18, 

25 ; : whichA stores .digital^ : 

12 . Alternatively, a video cassette recorder 107 can 
be: used to store real-time video 72. Database 18 
_ ; v includes . a database, management ... system : 114 .t^hat 
:\: traditional ' datatoase^.^ 

y^o7"-|^ manipulate . inf orrnat ion stored;; .^s;;4igit;al^ 

% v:; v :? ;Sv?^ / Analyzing,; . and? report ing^on) 

; * : ; J financial 1 transactions: occurring - 'at:^ clients ; ^12 . 

•Database- man system 114 supports any. suitable 

. ,. .ilat^fiie, hierarchical, relat iprial , ; pb j ect -oriented , 
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"V: 



In operation, server 20 receives data 82, video 
72, and optionally audio> 74 in' the form i of digital 
^ ■ -}\ files 14 fromr;networ 

• ■ 
" 5* : . £ 18 cont r 61 ler .- : 

■ V ■ y ;of |"<|^ i |ai|: f .il e s"l : i^||r<^ • cl^L enfcs v-- 

■'. ^2^:may:; ; -oc^ 

12, a periodic basis defined by server 20, or as a 
result of server 20 polling clients 12 with commands 
10 to download information. 

-•^cdigita^ to 
controller lib for presentation by graphic 
15 116 on display 112 . Using graphical interface 116, 

th^; :;.user . ^ah,! displa^^ ^felec t r view; analyze, and 
report;. '• pn information associated with financial 
transactions occurring 1 at clients 12 . 

v In an alternative en^odimenty server 20 receives 
20 data 82 and video 72 from network 24 in real-time. 

data 
:-as: 

a data wihdow on display-^ of 
" ■ 7 data" 82 / such - Y.as : . • a . . cash-'V register receipt . 
25 v ■ : ; AltW^ 

corresponding to data 82 from different ATM 78 or POS 
s 8 0 at the same or different location; Multiple video 
: ; .^;./^v;^|;■^■rr--• ' windows , each ;.;pne,v^-a ; ^4i^ ^fS^x ■. video 72 ; from ;> a 
^4'^:^ > : camera;|5^ 

!|}®^ dis^a^d if or '.^eac hv:yidep;{7 2-.f;-:}A^ .us e r^;:c an^s wit:ctt 

V : -" : {. -y^K V ■ ' : '^ : 72'jt>ased ' on what i s ,^ccur^.i^>^in a ^ • data? window or 
: views can be switched automatically based on some 

'§x0' : : ' preexisting ' criteria.. FIGURES 9-11 describe the 

§|f&^ techniques to - display- video 72 ;V a ^- data--;" 8 2 in • : a ; . 

f0:;'-- """ variety of arrangements^ . 
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Additionally, upon connection between client 12 
and server 20,. client 12 can automatically ^transfer 
data 82 to server .20 .This: /can ..be all the, financial 
"'iecord^/-'^ ,; j>l ; l^v,the' l : -.-. financial;. . 

./'•recordVo^ .^ r v ?^:;it- Ch€ . r ^;-: 

,. ', cpnf i^rat^ ^lll^'f^r- 
,cin/0database ': :; 18 V or : /the ciient'.s ! : database:; '"'16 for 
further/information. Data configuration 15 can 
control the display of data 82. For example, data 
configuration 15 can have the display show total sales 
.. ' for, a , certain. ,, time .period. P^?^, .^^. }: )^ : :-^^?^ B of 
K:. terns- : ^rchasM : i ^FIGyRE; vl 2 :..descr.ib^?.^in|mpre, de tail •. ■. 
.techniques /fpr^u^dat^ 

. FIGtTRE ' 4/|lillustrates . in more detail: ,■ the 
components/ of graphical interface 116. Graphical 
interface 116 includes a tabJLe 120 haying a number of 
entries 122 associated with ^ inancial .transactions. ; 
Each entry 122 includes all ori ap portion, of data 82 
generated by . POS 78 or ATM . . 80 : .at . client 12, 
Highlighted entries 124 may be emphasized by shading, 
. ,.fpnt: c chang|s color, differences^ ; .or^othe£ appropriate 
i.' . c.:te$hni^| : t^gln^i^ : 
video Jalid/br / ? ^dib' : /' ' In' ' 'a-y^parj^^^rv: embodiment, 
... entries 122, correspond to data receiyed ; from; clients 
' 12' operating, in .a..f irst mode in .which . digital , file 14., ; 
includes /'idat a 82 , ^ and highlighted ' entries 124 
.correspond to information retrieved f.r.pm clients 12 
.operating., in, a, ...second mode, in ^ich ,digit|l ..file, 14 ;> 

tv::j : ^ssociate^ 

particular defined exc-pt ion conditions/84 at clients 
12 ., . . Highlighted ,e r.v. r io.£. .124 .may .. then. .. be quickly 
/recogni zed^y^he.; ;u:s= ; r, ^C/se rye rg£ 0 alnd\^alyzed - 
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suspect or more closely monitored financial 

transaction. 'r' ' J-^'' - 

^\;V ;vVupqn -a buser selecting^ hi ghlighted gentry 124 using : 
. ■ V^":.^ device <1 13 > / y . 126 presents va still 

. •; M^:Pttam^ y. 6r-a; ? "se lecte% ; ^ part i ai : '> o r, " f u 11 mo t i on; ^, ' 

;>r^:; ; :^ : ; ;:• 

ehtryfti^ 

simultianeously with video 72. The user may manipulate 
a toolbar 128 to play, pause, stop, fast forward, 

10 rewind, adjust the volume, or perform other 

appropr iat e -f unc t ions to analyze video 72; and : audio 74, 
' p^e'sent;ed:^ ; '\Furt her more,: ' 

video (window box 130 

that allows the user to analyze^ se lee ted: portions of 

15 video 72 in more detail using, zoom; pan, and other 

functions; The storage of vide 72 and audio 74 as 
digital information enables more sophisticated 
analysis techniques; such as the techniques provided 
i>y toolbar 128 and magnification box 130. 

20 Graphical interface 116 also includes a 

: ":^;searQh^repp . of 

- ''^y-F^yy^': ^se f y particul^ 

to View' in table 120 . For example, search/report 
window 132 may prompt the user for a number of 

25 " " parameters that specif y ; the desired f inancial ' 
trarisactions to view. Parameters may include time, 
date,- sfebre identifier, register identifier, amount of 

^i^;;^ a particular '-^ 

^;:'";:;.:' ; -' ; ' : '- 

\30 ; v^ : v,parame^eir Search /report • • ; ' •-:':;••.•:. 

/^f-^i--^ ,incl^ 

. :.:: v ': : reporting," .and .- analyzing ^capabilities: of .'server 20 . •••• 
FIGURE 5 illustrate: digital file 14 generated by 
client 12, optionally s-orod in database 16 at client 
•3 5 :: ^-;; -V'.:-. 5 " -1 2 , : ahd Vs t ored 'in da t a r h s ^ 1-6 -at^server '' : '2b'^^''' Digital^."' 
file 14 includes data 8.:-: r-n^rated by ATM 78 or POS SO 
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at client 12, video 12, and audio 74. As described 
above , client ,. 12 operating in a. first mode in which 
. .exception, condition: 84 is not. met mav only .include 
■ ! dita -82 in digital file 14 : . . However , in a second mode 
: /..:|n which .'exception condition. 84 is met, vclient 12, may ■■ 

digital file 14. / : • ^ • 

Data 82 includes a transaction identifier 200, 
date and time 202, POS or ATM identifier 204, and site 
identifier 206, which may all be considered together 
as identifiers 208 that uniquely specify digital file 

* .!l4 ^n; : system" 10 .^iata>B2 r also- includes, transaction;; 

! ; data /210^ .that may .specify transaction type, item 
identification, item cost . ' taxable amount , : amount 
tendered, tax added, total, withdrawal amount . account 
information, user information,, keys; depressed at 
AXM 78 or POS 80 during the financial transaction, or 
any other data associated, with the financial 
transaction: Controller 76 at client 12 may analyze 
transaction data 210 to determine if/ exception 
, condition 84 ...is met., Data 82. may also include other, 

• ^datat 212 , : '•such4^s/;a/> measi f r ^: . °* xh ^:A^ -'^//^"r 
X . register door is open, an identifier of the employee 
on duty, an estimate of the number of persons in the 
stored "or. other information not directly, /related^ to 
.the financial transaction but provided in data 82 for 
further analysis of the financial transaction. For 
. ,.. , clarity, .. digital., file. 14 , in , FIGURE^. ? 5 . arranges, 
/•'information/ in -i blocks : > However , /data; 82 , ^video:{72 ,;.:; 
: / t^ar^ "audio ; 74 /may; be; arrange^ In ; any.^fprmat ; or ; ;orderV ; 

^ ;/ ; /S depe^n^ 

/ ''''/^technology -used in system 10.': • ... v . ... ■ 

"/ : The maintenance of data 82, video. 72, and audio 
74 in '-a . single . digital . f ile., 14 : provides . several 
' . '/technical : advantages, //.Digi^l ; if ile ;.'14,; may.v/be; 
V ' scrambled, rearranged, encoded; or. otherwise processea 
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to prevent tampering or disassociation of data 82 with 
§fl4v.y v. its corresponding' video 72 v ;and audio 74. In: addition, 

■ ^.y^TA^ ■■tpr:;v : vgu,icki)^ 

more - sophist icated database; storage/ retrieval/ irid 
reporting functions to bei performed at server 20 

FIGURE 6 illustrates a flow chart of a method of 
operation of client 12 . The method begins at step 300 
v.-:' iwhere ithe j next . ^ inane i a 1 tirans ac t iph;; occurs at ATM 78^ 

xorSf rPQ^ ^C^geM^ ;'8 ; 2^-' 

■■"v^^aS'i^ : occiirreri^ the 

financial transact ion at step 302 . Continuously, upon 
the occurrence of the financial transaction at step 
3 00; or at any appropriate -time, microphone y: 52 arid 
cameras 56 generate audio/video; in format ion associated 
with financial transaction at step 304 . Throughout y 
this description , the term audio/video ref ersStb video ■ 
alone, : audio alone, or both video and audio. If 

converter 70 xmay , gene^ and v : ; 

y^yiaudi^ 

^^If -''controiler 76 determines that exception 
cpndi t ion .84 stored in database 16 is not met at step 
25 '■ "y^i^ arid stbres digital : 

file 14 including data 82 in database 16 at step 308. 
^yp- 'I ! f ' exception condition 84 is met at step 306", client 

f i;lei\l4^;s-- 

• J:-..' : ->\v ^/^/^vinol 72;/ :A and i /;pptib^ 

^:^iin ;^da t abas e V' 4 6 ^;a.t>is t.eg/ : 3 1 oy : \ yyy ;. ' yy -\.- : -r:l) x- x . 

f§|; : yv- : . ' \ - y -\y : \ - ^■.■^l^^:^B3M^3it j stjep ;/-312;, ••7'client.; : -- ';-12 : establishes . ' 
|Jj§ communication with server 20 or optionally alarm 

p*;. . monitoring station 28' at step 314. While, client 12 

.?';/•;• ■35-":;;r-i'-----' : ;; ' ma in t ains :a larm cprid i t i on - 85 /-client ■ i'2V:anUP^ ; 

or .station 2 8 exchange data, video, and audio at step 
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316 to. implement, a one-way or two-way audio/video 
conferencing Mink for remote . surveillance, management , 
; ? r;, supervision..; ,af;/alarm: condition 85 . persists at 
§§' ;. r - •' 'X'- :^tep : ;;\318;' client v ; li: anid/ :.s^rver /: 20 .. ;or •; station 28 

. ;^o^inue, to- : exchang^^data; ; 8 ;; 7 ; ^|; a ^;^ udib : , 74 . 
' }'^t'^st:ep;-3!l6 J! '/it' 'aiarm^.c6ndi?:ion. .85; ;; is( oV^r^at/.step ' 
• ' 318 ' ; and' the ' operation .;pf\ client? 12 ' is? 'not doriei.at 'step- 
320, the method returns to process the next financial 
transaction at step 300. 

If no alarm, condition 85 exists at step 312, 
client 12; determines whether t O: , send dig.it ay files. ^ 

Wi;^f0S- \. . Vf ilesf li'^-air^. ';tp/]:beilsent Xo^e^ 'I2 ; 

|p- " ''■"'"'■[, : - selects digital ^ files 14 to send at' step 324. This; 

P 15 may be done in. response to a command received from 

iji . .. seryer^2oi. or specify^ 12 or 

£B • ,,,reiwt:ely'-%serv^ 20 various parameters .. such as 

ft'X^' ■' time- site" identifier, register identifier^ :o^.rother 

If f - "• apprppriatev^paramet^r •. to select' . digital;-; /f^les. ■ 14 .. 

W[ 20 Controllers passes selected digital, files 14 to 

Hi'i \4: ,. codec.«8.6.:;if or,, format* ing^at ..Step 3;26 ./^.^nterface. 88 



^'wU.-;:v. rt 



^u£i ; hg^^ 

yfr^ ■■ ■ ' -• - : ■'•'-at : -' ;: '.step ./"Vm-.' ' : ;|rp:-- W •. updates 

II- . • ^database, I6^at,;^sl:ep,;.33p, . : for : ; example^.. by .deleting 

digital.: files^4 ^transmitted ,tp/ . se.rver.. : ?0 . S/ If the 
Operation 6f r client 12 is not done at 320 or client 12 
determines, not to send digital files 14 to; server 20 
§1'-; • .. w< at,istep,,r.322.,:. : the .me t hpd s , returns , to prpcess., ; the next 

It' \ : ^<*^f'^? ! : /'->v/h5re " serverY.'20^.;r^ 14'' 'from 

W':''/''"' : "' "asstciated^clients^.; Server 20 stores it he, received 

0; '' digital files 14 in, database IS a^. .step, ^.p,:, . Dashed 

f|4-/,,V: .:: 35 ':;';;;;;, " feedback .' arVow 404:?indi v ca-es that . steps,- 40^0: ? and 402 
§tr :; ;' ; -\ ' : execute ' in : paral 1 ; • n -ser i es , '. in ^he: background , 



20 



or in any other appropriate manner to receive digital 
files 14 from clients 12 . -\"':\.^V..r ■ " 

.(search^ 

; -select;|digi t al' i les^ tor e'd^in^at aba^i^; 18: v -to view : 

^a fr- t ep ; '4 0 6;C - 
database: management system 114 retrieves selected 
digital files 14 from database 18 and passes this 
information to controller 110 at step 408. Graphical 
interface 116 presents data 82 associated with 
jretrieyed digatal JElle 122 and 124 in 

: : t:ab^^ 116 also - 

highlight^:- p 

videb^ 72^ and optional -audio 74 at step 412; 

Upon selecting particular digital files 14 from 
database 18 and pfesenting entries 122 and 124 in 
table -1^0 r graphical interface, 116 : of server 20 
supports several ^ user functions as illustrated by 
branch 414; Graphica 1 interface 116 may support these! 
functions in parallel/ in serial, or in any other 
Af ashxon:;-:.t: b>;^l : lpW;- ; int;eractibn : ;J wit h'^th^ user of server. -' 
^20^^ st"0p>^ 
416 , graphical Interface 116 presents associated video 
72 and audio 74 ' in video- window 1 2 6 at" step 418. 
Q^aphical x interface 116 then : se^ices functions of 
toolbox 128 and magnification box 130 at step 420 to 
allow further analysis of video 72 and aiidio 74 
asspciate^: w^ : 124 

>f^ction ;at^ 
•;the.-;an^ 

; exaiiRi^^ £',■ server 20 :jTiay^ request;! summary 

statistics, print information, run predefined report s , 
or P.erf orm any other, function on data 82 displayed in 

: tabled a2 0 : :or as ^iigital f iles 14 in^ 

database 18 . 1 Graphica ■ interface lie outputs the' 
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results of the analysis and reporting functions at 

: v Btepv426,.» v . ; ;;..;•.>• v*;v : v.-- 

'.••The' user may! also. request a: new table at step .428,'. ; , 
by .. submi tt ing: another ..query, in. . search/^ report x window • . '■ ■ 
132 X-;';.Ih- : .response,^ ,thec : method ':;continuei^at:\stepj46.6 

'%heXopir*tion' o 
server .20 continues : to receive digital files 14 at 
step 400 and store digital files 14 in database 18 at 

step 402 . 

FIGURE , 8 illustrates,^ 

V-ittiipap^b':^ 

.' ".' = ■ dsjt^l^ Y ia ; a ; : ' ' . 

' . ^cpmm^nicj t ion . * ne tw Q rk . ,2i ^ ' as;.. previously disciissed in 
conjunction with FIGURE . 1. Each server 20 includes 
display 112 whichv is capable of displaying real-time 
video 72. and; : data 82 received from, client 1.2. In this 
; embodiment, ' video;' 72'f.Uy sent by' client ;l2 y over 
connection 24, as soon as it as- captured^ by camera 56 . 
This ; is : ; called real-time ; video, although it is 
.. ...^^t^^-ijaAp- the. limits,- pf. communipa.tipn .ne.^ .24. 

^ v li>ia||^ 

.. of; Videb; 72 and : its;, display; at server; 20. ,,.-.Data,:;82 
•i, corresponding.; .to • videp^7.2,;.-is also ' sen^ } alpng,. i netwprk 
'' 24V "'^Additional data 82 from other sources - at that 
. .location .can be sent along network 24 as can 
addi t iona 1. V idep . 72. from ,ot.her ,c^e^asj.^-,;.^, .-. , ..;.;„.,.. 

^Hy^vi^TB ;;'orliPbS .80 or : : ''any;;'.o.t.'her "' dev.ice ; ; V capable .."•'''of'.- 
, : . producing data ' . 82 generated by. J . a ;.; f inanr i a 1 
..transact ion... For example, , data ,: window . 127 .-.ay. 
, ..^represent ''.'..a. ,,live, : ' or;,:;.scrpJling ; .,;versipn;;of^,a 
' S register-- receipt ■ ' correspcn<iing to • the;;; image-; . 
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customer purchasing goods in a store in video windows 
IK- -V126 , Multiple d^ta ; windows. 127 can be overlkid on a 

-^'^'y:\ ''^^V'iudeo ■■ : windqw.- ,: 126' / > v e^ch corresponding,; toH an!; 

^l®S^v- "\ : Y^fcV^ -^-p^ wd^<l6W' ; ;; : -^ : switcliinq 7-'can • 

of criteria such as an alarm condition or preprogramed 
response. These include switching to video 72 based 
10 on ; data 82 (e.g., the presence of data 82, amount of 

• ley^l3; ot^ suitable; c^riteria# 

Server 20 may switch; arrange; or display video wihdbW 
15 126 and/or data window ;127: in response to these 

criteria.. "_..;-. ! ; ; J k 

.; . FIGURE ; 1 0; ill u s t rate s ; a display 112 divided inco . 
mult iple video windows 126 . These video : windows 126 
^ can be 7 from cameras 56 at the same or different 
j^fft V : 20 Ideations . Data windows 127 are overlaid in each 

§|^V;X;'" } ' r f : 'Videp^ ■ =:<;Mu^ . 

||| ; :; - : ; ' FIGURE ; 9 ; : v Mul t ipile ; video > windows 12 6 arid -dat^ 

- " ';" • 127 • may ' be ? repositioned; vresizedy Y^br^'- otherwise-' 
m : ;^r : 25 ; c manipuiatedf ""■pf^arr^^^ 

S0. discubsed above wi t h re f erehce to FIGURE 9 . T 

FIGURE 11 is a flowchart 'of real-time video 12 

v ; v.:/ . . ^and, : v.da t a ; 8 2 • : : . t r ansnvi s s^ipn . • .-::r V; In s t e p : : 5 P 0; > vcl i en t 1 2 ;.- 
sv> . . . rpm : f^f inane ial ; :t r ans ac t i on a t§ AT>i' : ^ 



network 24 to server 20 in step 504 ; Video 72 ar.:i 
data 82 are communicated in real-time and can be fr or. 
3 5: ;> ^multiple sources . v; I n ; ; s i: ep 5 0 6 ;> da t a • is v over lai!id ; a^ 

• data wiiiclbw 12 7 with video 7 2 on display ^12 r - ; 7;Serv*r r 
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20 overlays a single or multiple data windows 127 on 
m a. single. ..or , : mu J.t if^e ; v yideo , wind ?^ y in an V 

p.:. V -appropriate^ 

|§::'' ' ..rV^Ovy ief^rencj^ St§p .5pj|;deterpine^ : -.;ii: ' y; 

fly . • .'. a^chang^ j^tp ;la^; :.d'i^lay ; ' needV -to... be ;;ma^:. ba'sed'^n-^-a , . ; . 

' ;^nUlated ;by '^h operator , "are 'covered' in ' step 510 . 
These would include an operator switching to a window 
based on a transaction appearing in a data window or 
an operator switching .. camera views as part of a normal 
scan pattern,. In :; step 512, ; server 20 automatically 
vvl'- .iconfiguresi windows^ oh changes in video.; 72. -For 
. , "Example , sudden imovement may ^rigger a . videq.>indoW^;t^ 
'"appear'. Also;, if;; a camera ^ b^^ 
15 change : in a video window might be triggered. In step 

514; display .112 automatically changes due . to t 1 ) 6 
. presence or content of data 82, such as the amount., of ::y' 
purchase, the type of purchase , some alarm condition, 
: keystrokes, or other criteria. 

FIGURE 12 is a flowchart for a method of updating 
. ; data ,8 : 2, from, client 12 . . In ; step 52Q ,; a . link , between.; 
Sy-yy^ 

; ; ' involve & actual establishment^ of: a-, link over?: 
network 24 , .the restoring : \ of a paused link , " 
: ^initializing:; the ; update ...procedure/. oyer;r^a^ 

established link, or some other connection criteria or 
.prearranged transfer time.. In, sSep^522, : client 12 
communicates ; , ;; data. ; to,. sex;yer^|p s .. . .. ^his ^data ^82 ... can^ .. 

' V-'S^£;^Pt a ighuSerlJff ;{cer ; t ajng t e^s^l^ 

.„, ., '] 

' data that, conveys '' information .on the activity at 
client ,l2. . Data . 82 is typically, stored^^ at 
3 5"J-Sfe client S 
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time is accumulated in chat file. This file can be 
stored at server : 20 . upcmf receipt ; 

'.■■''r : y\ ^ ^ r in ; ; a\. 

■ ; f ormatfcd^ 

;.; y ; : -;.K V; : - ; .;tgtal^ ->bn? 

hand, -o:r-^ Confi^tiratloh file^ 

15 may be stored as an initialization f i 1 e or some 
type of configuration file. Configuration file 15 is 
10 designed to be updated easily to allow displays to be 

4esigriedj -ef f ic 20 maintains 

'■; ' • y • Ccoji^ ; thei- : 

••aderitity^ ■ 12> the icieht ity : ; of ■' 

the operator at server 20] a time measure («2\g., time 
15 of day, day of the week, day of the month, quarter, 

etc.), a particular report format , or any other 
appropriate criteria . 

In step 526 , the process determines if additional: 
queries need to be made . Additional queries ; can be 
20 made to extract data not transferred or to display 

.':-%data ■■■■iny-^an : ■ step 528; 

i: -< x 0;' v"^--- 1 ^ : are; to./:b£^^ thsit : 

is, at the server; If so , ; seryer;2^pefforins queries 
on the server ■ s database 18 in step 530 . If not , 
25 ^ - ;\ server; 20- per£^ the client 1 s -database 16 

in step 53 2. " 

Although the present invention has been described 
;: : :^v:;v<;-,^. : ' in, /^several.-.: embodiments , • : a myriad of ^ changes , 
.^••.••^yariat ions t'tansf o^atlonBV'" i and 

3 0:.';;:^7 ';• v/;;mp^i in: .the- 

^\r^^,y^ ?artv-;^and; ; ; 

. encompass " such,;;;v changes:, ' ; variations, ^^alterations ,.: 
transformations, and modifications/ as fall within the 
spirit and scope of the appended claims ;~ 
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.1. a video surveillance system, comprising: 
a client, operable to generate data associated 
with a financial transaction, the ;client having ; a \ 
camera operable>to generate, video associated ^ith th^ 

... financiar;.t^ 
|f ^ " ? '"' " data 'and video In a digital file; and ' 
t?; a server coupled to the client using a 

=F communications network, the server operable to receive 

. the. digital file from the client and to store the 
■ . digital -file , in , a memory, .. the; server, haying a 
^ ' -graphical 5interf ace . operable to retrieve . da?:a : and 
.'^ video from; the digital.^ : ile ^storM . in the, memory for.; 
presentation. 



15 
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2 . The system of Claim 1 , wherein the client 
comprises, a point-of-sale device and; the financial 
transaction comprises the sale of an item. 

3. The system of Claim 1, wherein the client 
comprises an automated- ...teller machine . and,;... the._ 
-finahcialv transact i|n^c<^i^.:a v cas^I wi tl>dr.a|ai o ■: 

4. The system of Claim 1, wherein the client 
comprises,: a ' microphone operable . to generate audio 
associated' with the f inancial transaction, the client 
operable, to store data, video,; and; audio in the 
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6. The system of Claim 1, wherein: 
the graphical interface at the server presents 
data as an entry in a table having a plurality; of 
i entries associated wi th ^ al ^ plural ity^ of £ inane ial 

/■ 5-' -; : '"- ; '\'trahisacti^^ "'■ v> . : ' 

\r : '• : 'y : l' \ ^tHe cg^ se^er presents 

video in response to a rselebtion of th£ entry in the 
table . 

10 7. The system of Claim 1, wherein the graphical 

i n t e r f a ce at the server presents data as an entry in 

;-;^a;;' table-^having:;,a plurality 
a: plurality of • financial 

entry highlighted to indicate the existence of video 
15 associated with the entry. 

8 . The system of Claim 1/ wherein: 
the client comprises a microphone , a speaker, and 
a display; ■ 
20 the server comprises a camera, a microphone, a 

■■ speaker , and a display ; ^and : ■■■^.•^<:^- : ^- . 

conduct two-way audio/video conferencing. 

25 t ; : :9 : ; The tsystem of :: i Claim: 1, wherein the client 

hais a first mode and a second mode of operation, the 
client in the first mode includes data in the digital 
f ile, the client in thev second mode ■ includes data and 

■ ; \" v'v. • yidep vin.r.th^ 

;3p; : ""^ ; 5; V/;^ an . . : ~ exc ep t i on i.V-- co nd i t 'i 6 n "' ; y' : of*. -v..' - the : financial; 

:;;-:/VvV ^ trans a cti oh ..V \ ' ; V ' /'f o-J: 1 7/:-:k\- •• ' 

10. The system o: Claire 9, wherein the server 
transmits information ""the client to define the 
3 5 v ^ except ion condi t ion ; - v • 
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;frv Iff" ' 
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11. A video surveillance method, comprising: 
generating data associated with; a . financial 

'^'.^'■'■••transaction;; ->K; i^f '^'^Ml^L' ^ ■'• 0"* 

: . : : : $0:M-:/::.:g^n^at.ing . video . associated with:^he ^iinancial ; ; 

-'■^^••'transaction;. .. '; .. "' : ;";''>'.'• : . .'•{"..', •' ..\;K;^^lX' .' : '-'. ••' . •; 

clierit; -;.•',' 

receiving the digital, file at a server using a 

communications network; 

storing the digital file at the server; and 
. . presenting. ; : data ; and. video; in the . digital f ile 
■•;■;. v using a graphical interface ., : ? ;■';;.;• 1 :, - ; : /|..'; •' " 

\ 3"' 12 . The method of Claim 11, wherein the client 

15 comprises a point-of-sale device and the financial 

transaction comprises the sale of an item. 

.13. The method of Claim 11, wherein the client 
comprises an automated teller machine and. the. 
financial transaction comprises a cash withdrawal. 



10 



20 



%S..-i^ ;.furt^e|^cpmprising-. 

the steps .of':"*"" \.r 

generating,: audio, associated with : the financial 

. /'••••25'&.€. : ^ and; a. ^^v- v-^-.-: 

'" ' storing the audio in; the digital file,; at the 

- '•. •••.: ; \.. -•••client . 

. '-f^ ••••15';. - : ^helSethod , of ;:\Cl aim /l i:;^whe.re i rv'\ t h|.^digi;t a 1;. 

Xi "< -.^ASSSI^ ;■;":•'.'; 
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16. The method of Claim 11, wherein the step of 
presenting conipf ises :^ V 

/ ; ^re s^nt ing • ;data }aa[ an -entry in a t 
-£lurs&it^ 

arid 

presenting video associated with the data in 
response to the selection of the entry in the table. 



17 . :: The: meth6d . of Claim llv whefeife the step of 
• fipre sent ing comprises : . , -)- : ' 

• p an entry in a table having a . 
plurality of entries associated with a plurality of 

15 financial transactions; 

highlighting the entry to indicate the existence 
of video associated with the data ; and : 

presenting video associated with the data in 
response tMfefselectibn of the highlighted entry . 

20 

• 18 The me t ho4 t> f Cl a im 1 1 / v where in the ^step.^ 
:S;st^ comprises ::: ^ /".B/; 

Ul ; storing data in a first mode ; and 

storing data and video in a; second mode 
ilS 25 associated with an exception condition of the: 

financial transaction. 

v 19 . ,-■ ;XThe---: i ine ; thod-:- of Claim,: 18> further comprising; 

f rom the -seryerf 
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20. The method • of Claim 18 , wherein : 
the client .comprises ,a :point.-.of - sale device.: and 
~ - the financial .\trinsaction:fcomprises ; .the. sale of an : 

; " of- one of - ; a selected : no • sale and : void : keys; ^h- the 
point-of-sale device. 
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jpl';:. 21 . A video surveillance system, comprising: 

' • to -y generate :v.da^a;o:\asspci 

^fy^;::::-.; ; ySc^ 

-1^" •'; ' • :-'ym&^ transactiprt^;^t^ 
network; and 

I y a server coupled to the client using the 

10 communications network, the server operable to receive 

f|v.; the .data and video f rom the c 1 i ent and to display : the 

l^tty. ■ videb Sandy dkta in - t ime . 

|?-f 22. The system of Claim 21, wherein the client 

15 comprises a point-of-sale device and the financial 

transaction comprises the; sale of an item. 



:^vy\ s 



23 . The system of Claim 21, wherein the client 
Jj^y? comprises an automated teller machine and the 

|yi. 20 financial transaction comprises a cash withdrawal. 

|§§ : y.-.\y y ■■[.-, y'" ^vS^'^yiy y^; :v The '^sys t em^bf ^Claim '2l>;- wherein ^they: client - 

comprises a microphone-operable to generate audio 
associated with the financial transaction, the client 
25 ; ope r able to t r ansmit : da t a , video, and audio over the 

communications network. 



:y.v- 2 5f. y, ; The, sys terruof -Claim 21, wherein the serve r v y: 

v^r ::: -^'-^ •data ; -andfa^vici^O;-w 
?30^^ da t a V y^in^w on ^ ^ he v 
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26. The system of Claim 21, wherein the server 
presents ; data .from ... a plurality ;,^ 
transactions , as a plurality ..'of data ; widows ^. ^p^Qents 
>yideo Vf rom a ! plurality of .iyidepj sp 

of ? videp^ windows! : 

\the corresponding; video wi^ *■ -::>;V v \h)v ■ 'V.v , ■■' v '-'--- 

27. The system of Claim 26, wherein the server 
receives user input to specify one of the data windows 
to display the video window associated with the 
specif ied data window . . . . .. . 



28;. The system of-;Claim^;-26 :/ ; where i^ server 
associated with the : financial ;^ transaction 
15 automatically switches the yidep window to the video 

associated with the data in ^response to the presence 
or! content of data. 

29. The system of Claim 26 > wherein the : ; s 
20 displays the appropriate video window and data window 

.^ x , . upon changes in one of the plurality of ; yi.deo windows. 

■^^■•■Ay':':' : : 30 . The system ■'; of i-Claim 2:1 ; wherein it lie client 

stores accumulated data associated with, the, f inancial 

25 - transaction and : transmits ,t he , the client 

communicates with the server.. 



WO 98/01838 



PCT/US97/12OO0 



32 



HP 0 ; 



10 



31. A video surveillance method, comprising: 
• - generating data -associated: with a y f inancial 
•transact ion.;. ri: [t -^-'^^fj^i '^j^^-k^-: 

V • 
•transaction ;• "S : .\ : - ?Sir ^• •;^ : >; ; ' 7v' ; ' ■ ' ^^^^^ ,. 
f ^ : • : f\^.t: rinsmi t t^^ ; y;da t a • . arte - video i n \rea£^ a; 

client ; : •• ' 

receiving the data and video at a server using a 
communications network; and 

presenting data and video on a display at the 
server;., ./O'-... -■■■■"■'■■.■.'■.v.'.' 



■ ^%^3 : 2-^ client 
Emprises at point-of-sale device and "the financial 
15 transaction comprises the sale of an item. 

;,v 33 9 The method of Claim 31; wherein the client 
comprises an automated teller machine and the. 
financial transaction comprises a cash withdrawal . 

20 ■ ' N . : 

34 . ; ^he ^ comprising; 

; thW ; steps J of /^:'7' : r"\/7 ; -' : v7 - '"V"'}'' ■ " : 

generating audio associated with the financial 

transaction; and 
25 v transmitting: the aiadio to the server .: 



35. The method of Claim 31, wherein the step of 
. pre sent ing ( jcpmp^ises^ ;. ■{ 

V . overlaying ^th^d^ on; : the : video window . 
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36. The method of Claim 31, wherein the step of 
presenting comprises . r. •- 

: : :.;i;presenting' ; data: ; :as a. plurality, of data windows 
V^ssociatediwith a ; plurality .of financial . transactions;. ../ 
.'.,,;)'.'•' '. 'presenting;: video as'f a plurality 'of video^windows^ ' : 
.. C i issociati&ith • a • plurality of, v^eo^o^rc^s);^^ 

" :V ' V " '.Ss^ciatihg' the ^ data: window ; with; ■ the ; 
corresponding video window. 

37. The method of Claim 36, further comprising 
. .the step of updating the video w : 

'•^windffi 

■ data; ; in : ;one of the plurality; of; ; data windows. . 

38. The method of Claim 36, further comprising 
the step of updating the video window and, the data 
window 4n response to a change in one of the plurality 
of video windows. : 

39. The method of Claim 36 , further comprising 

. the steps ; /of :. ;.•>•/ * •". ' - ■. -.f;-. '• / 

■■ .;s : ^;:rec ; eiv;ing.^a ; us|r selectibn^:; and:; '^F-^.-^F^ 
? ' : ' updating ^the -v^eo^windOw ;ahd :£h$ data window in 
response to the selections ^ 

. 40! The method of Claim 31, further comprising 
the steps of: 

, ; storing; accumulated f inane ial. d^ta in a f ile ^t 

i'-fv-V theiJciieht-irKA-^ •> '•••r-- : . ,: : -^"^-v . '' ::;: :Cv : . "■*<:. '■' F- 

[^MB^^xtiing, the;,, file; ;;f rom;.. : the ; : c lient; ; : : to :;the. 

'-; ; ^|serS"u|oh^ 

41. The method of Claim 30, wherein the digital 
file contains financial records accumulated since last 

-'connection.. 
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42. A video surveillance system, comprising: 
•a client operable to ; generate -- ; dctta; ; :-assbcikted' 
transaction and to ^ accumulate: a 

■ r ."" • s t or e " • t he data a^ 

: • ; ti^Sdata ah& video across ••• a communications network; 
and 

Wi, a server coupled to the client using the 

10 communications network, the server operable to receive 

11% r : the > digi t al f i le iuppn ^connect ion with the ^client , to 

'; - . ;d£s£l ay;: the>yidTO . v. 

1^ 15 43. The system of Claim 42, wherein the client 

f|S comprises a point-of-sale device and the financial 

fe# •. transaction comprises the sale of ari item. ; ; 

.- The system, of ;^ Claim 42 , wherein the client 

Ifil; 20 'comprises an automated teller machine and the 

( f inancial transaction;; comprises a cash i withdrswal . 



^vw^- f •• 45 . The "system bf ; Claim 42 , 'wherein .the client." 
i|iS comprises a microphone; operable to generate audio 

25 associated with the financial trans the ' client 

|# operable to transmit data, video, and audio over the 

communi ca t ions network 

llfF vSV'^ ^^)^^y§%^f^tv Claims 4 : 2.:,:. - whfc r e in ^theirserver" 

; -3;o£ ; :>/■' ' ;v ; " : f prms;^ a? dat^ . ;and?A^;y^ 



; - video window^; ; ;[ - :? '^Y'y^-. ' v..:-. ,:. ': ; .:: . V; " 
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47. The system of Claim 42, wherein the server 
. .presents data from a k! plurality .of financial 
transactions^ as a plurality of dat a windows , ^presents ; 
Vid^o from-a plurality of video sources as a plurality 
v 5 • of video -windows, and assqciates^the - : di^ 



6?? 



10 



48. The system of Claim 47, wherein the server 
receives user input to specify one of the data windows 
to display the video window associated with the 
specified data window. 



';'$9 i The system of ^ Claim- 47 wherein the server^ 
||?; associated with the ^ financial v transaction 

15 automatically switches the video window to the video 

associated with the data in response to the presence 
or content of data. 

; 50. The system of Claim 47, wherein the server 
20 displays the appropriate video window and data window 

til .-0-..0-. up^ changes in c^e^of the 'plurality of : yideo windows. 



;: " -^'-y 51 . The system: of Claim 42, wherein :the client 
stores accumulated data associated with the financial 
; ^ 25 ..." transaction arid .transmits^ the - data when the client 

communicates with the server. 

^ 52. The, system of Claim 42, , .v^heref n ; ^t:he^ seryer 

%^\S/' v; ; -C ' '•' cni jjvc.i thft ^ci i a i t a 1 . ^ f i 1 e : bksed, onf^ bbrif iguratitfn 

fS%v v .• . 30 : -\ 
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r ^^' : ^ generating , video \ associated with^ the 5f inahiiWi 



§|ik y 53 . A video surveillance method, comprising : 

■■ v-;-^: : ; . i vs^ generating data ■ associated with a f inane ial 

W^ :: . : .'^ : 'l:' : '- -.: : ":vV ■ t.ranstaction>; .V: ' • : ' \ :-y y' : .v'\V ;: ,' . ^ : : ' 

fit- 

I^H^U;;;' ' ^ ^^i^: vo ^^^ ;: :-vt ransac t ion ; • 

^12? storing accumulated data as a digital file; 

transmitting the digital file upon connection of 

fl-:^ the client and the server; 

W%- 10 transmitting data and video in real-time from a 

^ client; 

' receiving : the; data and; yideo at ;a - server usin^va 

. • -communication^ : -" • •:. .y--% 

W^r-' ' presenting- data and video on a display at the 

15 server! 



54..? The method of Claim 53, wherein the client 
comprises a point-of-sale device and the financial : ; 
$^fi transaction comprises the sale of an item. 

p|:fe- : ; 55:. The method of .Claim 53, client >i 

: cprr^rises %an ; automated teller ; ; machine ^ and :.' the^^- 
|p: financial transaction comprises a cash withdrawal . 

^7 25 56; The method of Claim 53 ; further comprising 

■ ' ' the steps of: 
fc§;f generating audio associated with the financial 

E&v.u' : ' transaction; and •,• ^w;-W- 

::';-S^V;;^y^'tr^nS^ ■^::}^h': 



30 



■ presenting; comprises \ -y^- ^P" ^ ^7-''' P^-/ ; 7 ' ; ''§:; v ^ 

presenting data ir: a data window as a 
representation of the financial transaction; 
3 5 pr e sen t ing vi deo i r. -y* video window ; and 

overlaying the dar-a Window on the video window. 
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58. The method of Claim 53, wherein the step of 
presenting., comprises : 

; . presenting ^data as : a .plurality ,of : Jclata windows 
'■ ]'■ associated • with '^/t)lura.litY.vOf f inane ial^; tiransact ions., 
• 5:- - on a display at the ^server; ' . '^r. ' J;r/y : \yl[ 

J ' - presenting video: as 

•' V . ,: " { ' : aslocrat^ of "video" 'sources oil a" 

display at the server; and 

associating the data window with . the 
10 corresponding video window. 

} ,;/59. ; v './-.The^ 

the step of updating the yid 

window in response to the presence or cpntent of the 
15 data in. one of the plurality of data windows . 

60. The method of Claim 58 , further comprising 
the step of updating the video window ^ariti; the ;<iata 
window in response to a change in one of ; t he pi ura 1 i t y 
20 of video windows. 



'f\:^?\f i i ; "^y^i^ : ,Th$". V m| t hod ; :^f-\iClaim^5 3 / : Jur £ her,v co^rlslr^ 

l!^ ' '■■"'^ - : thesis teps/'of ':'.- '' 'V • . ; "■■ -r--- : : . /" 



r receiving a user selection; and ■ ; 

■2 5 • and the data winciow in 

: " " :: iv;*%y response ■ to the "selection . 

v ^ : 62.; . The method of Claim 53, wherein the . digital 

f ile ■ contairi^f inancial;- records • accumuia t ed r . s ince ;l?st 

vr^W'cohhection. • / / . '-^ '../^ ■•" -V:- "* V- ; • 
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